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Filing of amendments and statement under Article 19: 

The applicant is entitled, if he so wishes. 1i> amend Hie claims of 1he international application (see Rule 46): 
When? The time limit for tiling such amendments is normally two months from the date of transmittal of the 

international search report. 
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applicant's request to forward the texts of both the protest and the decision thereon to the designated Offices. 
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before the completion of the technical preparations for international publication 
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examination must be filed if the applicant wishes to postpone the entry into the national phase until 30 months from the priority 
date (in some Offices even later); otherwise, the applicant must, within 20 months from the priority date, perform the prescribed 
acts for entry into the national phase before those designated Offices. 

In respect of other designated Offices, the time limit of 30 months (or later) will apply even if no demand is filed within 1 9 
months. 
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This international search report has been prepared by this International Searching Authority and is transmitted to the applicant 
according to Article 18. A copy is being transmitted to the International Bureau. 

This international search report consists of a total of 2^ sheets. 

I I It is also accompanied by a copy of each prior art document ciled in this reporl. 

1, Basis of the report 

a. With regard to the language, the international search was carried out on the basis of: 

fX| the international application in Hie laniduano in which it whs filed. 
□ 

a translation of the international application into which is the language of 

a translation furnished for the purposes of international search (Rules 123(a) and 23.1(b)). 

b. I I This international search report has been established taking into account the rectification of an obvious mistake 

authorized by or notified to this Authority under Rule 91 (Rule 43.6A;.i(a)). 

c. Q With regard to any nucleotide and/or amino acid sequence disclosed in the international application, see Box No. I. 

2 CH Certain claims were found unsearchable (see Box No. II). 

3. CD Unity of invention is lac king (see Box No. III). 

4 With regard to the title, 

[X] the text is approved as submitted by the applicant 

□ the text has been established by this Authority to read as follows: 



5. With regard to the abstract, 

[Xl the text is approved as submitted by the applicant. 

□ the text has been established, according to Rule 38.2(b). by this Authority as it appears in Box No. IV. The applicant 
may, within one month from the date of mailing of this international search report, submit comments to this Authority 

6. With regard to the drawings, 

a. the figure of the drawings to be published with the abstract is Figure No. J8 

□ as suggested by the applicant. 

as selected by this Authority, because the applicant failed to suggest a figure. 

□ 

as selected by this Authorirv, because this figure better characterizes the invention, 
none of the figures is to be published with the abstract. 
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A. CLASSIFICATION OF SUBJECT MATTER 
IPC(8) - G06K 9/00, H04N 5/228, G06K 9/62, G06T 1/00 (2008.04) 
USPC - 382/236, 348/208.4, 348/400.1, 382/284 

According to International Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification svslem followed by classification symbols) 

USPC - 382/236, 348/208.4, 348/400.1, 382/284 

IPC(8) - G06K 9/00. H04N 5/228. G06K 9/62, G06T 1/00 (2008.04) 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 
USPC - 382/236, 348/208.4, 348/400.1 , 382/284 (text search) 

IPC(8) - G06K 9/00, H04N 5/228, G06K 9/62. G06T 1/00 (2008.04) 



Electronic data base consulted during the intemath 
PubWEST (USPT, PGPB. EPAB. JPAB): google. 
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>h (name of data base and. where practicable, search terms used) 
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Citation of document, with indication, where appropriate, of the relevan! passages 



US 2005/0128518 A 
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9-11, 26-28, 45,46,49 
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"A" document defining il-.c i',c:ie..il «uk ol ru an winch is not considered dale and not in conflict with the application bin cited to understand 

to be of particular relevance the principle u. theury underlying the invention 
"h" earlier application or patent but published on or after the international "X" document of particular relevance: the claimed imciiiion cannot he 

filing date - inMdcrcc: novel :ir .aim.! he . in.sic.ercd lo ui.nl.e an imcniivc 
"L" document which may throw doubts on priority claim(s) or which is sle P when the document is taken alone 

cited to establish the PuWication date of another citation or other „ Y „ documen| of panicu , ar ^ emn(J| be 

special reason (.as specmeu; considered to involve an inventive step when the document is 
•O" document referring to an oral disclosure, use, exhibition or other combined with one or more other such documents, such combination 

means being obvious lo a person skilled in the art 
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indications relating to the following items: 


1X1 Box No 
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Basis of the opinion 


□ Box No 
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1 I Box No 


III 


Non-establishment of 'opinion with tegaid in novelty, inventive step and industrial applicability 


I | Box No 


IV 


Lack of unity of invention 


IXl Box No 
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Reasoned statement under Rule 436«.l(a)(i) with regard to novelty, inventive step or industrial applicability, 
citations and explanations supporting such, statement 


□ BoxNo 


VI 


Certain documents cited 


| Box No 


VII 


Certain defects in the international application 


| Box No 


VIII 


Certain observations on the international application 



2. FURTHER ACTION 

If a demand for international preliminary examination is made, this opinion will lie considcied to be a written opinion of the 
International Preliminary Examining Authority ("IPEA") except that this does not apply where the applicant chooses an Authority 
other than this one to be the IPEA and the chosen IPEA has notified the International Bureau under Rule 66.16u(b) that written 
opinions of this International Searching Authority will not be so considered. 

If this opinion is, as provided above, considered to be a written opinion of the IPEA, the applicant is invited to submit to the IPEA 
a written reply together, where appropriate, with amendments, before the expiration of 3 months from the date of mailing of Form 
PCT/ISA/220 or before the expiration of 22 months from the priority date, whichever expires later. 
For further options, see Form PCT/ISA/220. 



3. For further details, see notes to Form PCT/ISA/220. 
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International application No. 



Basis of this opinion 



1 . With regard to the language, this opinion has been established on the basis of: 
fX] the international application in the language in which it was filed. 

| | a translation ot the international application into which is the language of a 

translation furnished for the purposes of internalional search (Rules 12.3(a) and 23.1(b)). 

2. | | This opinion has been established taking into account the rectification of an obvious mistake authorized by or notified 

to this Authority under Rule 91 (Rule 43A<j.l(a)) 

iplication, this opinion has been 



□ 

a sequence listing 
I I table(s) related to the sequence listing 

format of material 
I I on paper 
I I in electronic form 

time of tiling/furnishing 

contained in the international applicatioi 
I I filed together with the in 



I I furnished subsequently to this Authority for the purposes of search 

I | In addition, in the case that more than one version or copy of a sequence listing and/or 1able(s) relating thereto lias been 
filed or furnished, the required statements that the information in the subsequent or additional copies is identical to that 
in the application as filed or does not go beyond the application as filed, as appropriate, were furnished. 

5. Additional comments: 
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Box No. V Reasoned statement under Rule 43bis. l(a)(i) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting suchstatcmcnt 



1. Statement 

Novelty (N) Claims 9-11.26-28,45,46,49,51,52 YES 

claims JAl 2 ! 2 !: 29 ^ 4 : 47 ^ 50 NO 

Inventive step (IS) Claims "° ne YES 

Claims 1 5 2 NO 

Industrial applicability (IA) Claims YES 

Claims none NO 



2. Citations and explanations: 

Claims 1-8, 12-25, 28-44,47,48, and 50 lack novelty under PCT Article 33(2) as being anticipated by US 2007/01 10417 A1 (Itokawa). 

As per claims 1, 22, and 36, Itokawa discloses a digital image processing melhod and image capture device for detecting and correcting 
visual imperfections using a reference image, comprising: (a) capturing, on a hand-held or otherwise portable or spatial or temporal 
performance-based image capture device, a main image and one or more reference images having temporal or spatial overlap or 
proximity with the main image, or combinations thereof (see Abstract; para |0008]); (b) analyzing on the device the one or more reference 
images for enhancing the main image (see para (0079)); (c) correcting on the device one or more defects or other sub-optimal 
characteristics in the main image based on the analyzing of the one or more reference images to create a modified images comprising an 
enhanced version of the main image (see Abstract; para [0010]); (d) displaying, printing, transmitting, or storing the modified image or a 
further processed version thereof (see Abstract); (e) whereby the correcting on the device of the one or more defects of other sub-optimal 
characteristics of the main image based on the analyzing of the one or more reference images produces al the device an enhanced main 
image from an original image in real-time with spatial economy and performance efficiency (see Abstract; para |0008]; [0010]; [0079]). 

As per claims 38. 39, and 43, Itokawa discloses a handheld or otherwise portable or spatial or lemporal performance based image capture 
device, comprising: (a) one or more lenses, one or more apertures and one or more sensors for capturing a main images and or more 
reference images has a temporal or spatial overlap or proximity or combinations thereof, with the capturing of the main image, or 
combinations thereof, and the main image is captured using a primary optical system while the one or more reference images are 
captured using a secondary optical system differing from the primary optical system in focal length, depth of field, depth of focus, exit 
pupil, entry pupil, aperture, or lens coating, or other optical parameter of a designed lens, or combinations thereof (see Abstract; para 
[0008]; (0010); [0079]); (b) a processor (see para [0047]); (c) one or more processor-readable media having embedded code therein for 
programming the processor to perform a digital image processing method that comprises: (i) analyzing on Ihe device the one or more 
reference images for enhancing the main image (see para [0047J; [0079]); (ii) correcting on Ihe device the one or more defects or other 
sub-optimal characteristics in the mam image based on the analyzing of the one or more reference images to create a modified image 
comprising an enhanced version of the main image (see para [00*0]); and (iii) displaying, printing, transmitting, or storing the modified 
image or a further processed version thereof (see Abstract); (iv) whereby the correcting on the device of Ihe one or more defects of other 
sub-optimal characteristics of the main image based on the analyzing of the Dne or mroe reference images produces at the device an 
enhanced main image from an original image in real-time with spatial economy and performance efficiency (see Abstract; para [0008]; 
[0010]; [0079]). 

As per claims 2 and 23, Itokawa discloses the method of claim 1 and image capture device of claim 22, wherein the main image and at 
least one reference image comprise flash and non-flash version of a substantially same scene (see para [0081]). 

As per claims 3 and 32, Itokawa discloses the method of claim 1 and image capture device of claim 22, wherein at least one reference 
image comprises a hi-speed capture to freeze motion of a substantially same scene as captured in the main image, and said one or more 
defects comprise a motion defect (see Abstract; para [0081]). 

As per claims 4 and 33, Itokawa discloses the method of claim 1 and image capture device of claim 22. wherein at least one reference 
image comprises an infrared version of substantially the same scene as captured in the main image to enhance heat emitting objects in 
the frame (see claim 17). 

As per claims 5 and 34, Itokawa discloses the method of claim 1 and image capture device of claim 22, wherein the main image and at 
least one reference image comprise different focal distances (see para [0083]: |0084)). 

As per claims 6 and 35, Itokawa discloses the method of claim 1 and image capture device of claim 22, wherein one or more reference 
images comprise a plurality of images organized as a video clip (see para [0034]). 

As per claims 7 and 24. Itokawa discloses the method of claim 1 and image capture device of claim 23, further comprising segmenting the 
main image into foreground and background regions, and modifying one of the foreground and background regions based on the one or 
more reference images while not similarly modifying the other of the foreground and background regions (see para [0083]). 

(see continuation of citations and explanations in first supplemental box) 
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In case the space in any of the preceding boxes is not sufficient. 

Continuation of: 

Box No. V(2) -- citations and explanations 

As per claims 8 and 25, Itokawa discloses the method of claim 1 and image capture device of claim 22, further comprising detecting a 
region containing a face within the original main image, and modifying the face region based on the one or more reference images (see 
para [0083J; face - portrait). 

As per claims 1 2 and 29, Itokawa discloses the method of claim 1 and image capture device of claim 22, further comprising correcting a 
blur defect in the main image based on the one or more reference images (see Abstract). 

As per claims 1 3 and 30, Itokawa discloses the method of claim 12 and image capture device of claim 29. wherein the blur defect is 
caused by an incorrect depth of field (see para (0054); (0055)). 

As per claims 14 and 31 , Itokawa discloses the method of claim 1 2 and image capture device of claim 29, wherein the blur defect is 
caused by motion during image capture (see Abstract). 

As per claim 15, Itokawa discloses the method of claim 1 , wherein the one or more reference images are captured using one or more 
different capture parameters than the main image (see para [0079]). 

As per claims 16 and 37, Itokawa discloses the method of claim 1 5 and image capture device of claim 36, wherein the one or more 
different capture parameters include exposure time, dynamic range, contrast, sharpness, color balance, or white balance, or combinations 
thereof (see para [0079)). 

As per claim 17, Itokawa discloses the method of claim 1 , wherein the main image is captured using a primary optical system while the one 
or more reference images are captured using a secondary optical system differing from the primary optical system in focal length, depth of 
field, depth of focus, exit pupil, entry pupil, aperture, or lens coating or other optical parameter of a designed lens, or combinations thereof 
(see Abstract; para [0054]; [0055]; [0079]). 

As per claim 18, Itokawa discloses the method of claim 1 , wherein the one or more reference images include at least one reference image 
that includes only one or more sub-component features of an overall scene captured in the main image (see para [0079]; portrait, 
background). 

As per claims 19 and 40, Itokawa discloses the method of claim 18 and image capture device of claim 39, wherein the one or more sub- 
component features comprise a center of the overall scene captured in the main image (see para [00B5]). 

As per claims 20 and 41 . Itokawa discloses the method of claim 1 B and image capture device of claim 39, wherein the one or more sub- 
component features comprise a face, faces, or region or regions of a face or faces captures in the main image (see para [0079]; [00B5], 
face - portrait). 

As per claims 21 and 42, Itokawa discloses the method of claim 1 8 and image capture device of claim 39, wherein the one or more sub- 
component features comprise a foreground region of the overall scene captured in the main image (see para [0079]; [0085]). 

As per claim 44, Itokawa discloses the device of claim 43, wherein the one of more reference images comprise a reference image 
including an eye region, and said correcting comprises replacing a corresponding eye region of the main image wilh said eye regions of 
said reference image (see para [0010|; (0079], eye - portrait). 

As per claim 47. Itokawa discloses the device of claim 43. wherein the one of more reference images comprise data of a region of interest 
(ROI) at a same or higher resolution as said main image (see para |0079], ROI - portrait, background). 

As per claim 48, Itokawa discloses the device of claim 47, wherein the ROI includes an eye region (see para [0079], eye - portrait). 
As per claim 50. Itokawa discloses the device of claim 47. wherein the ROI includes a mouth region (see para [0079], mouth - portrait). 



Claims 51 and 52 lack an inventive step under PCT Article 33(3) as being obvious over Itokawa. 

As per claim 51 , Itokawa does not specifically disclose the device of claim 50, further comprising determining that said mouth region has a 
better smile than a corresponding mouth region in the main image, and replacing the mouth region in the main image with the mouth 
region of the one or more reference images. However, Itokawa does disclose replacing defective portions of a portrait segment of an 
image with a reference image to correct the defects (see Abstract; para [001 OJ, [0079]). Therefore, it would have been obvious to one of 
ordinary skill in the art to replace specific parts of an image , because this allows the best parts of several images to be edited together into 
a superior result 

As per claim 52, Itokawa discloses the device of claim 51 , wherein said mouth region of said one or more reference images is captured a 
fraction of a second before or after said main image (see para [0034]; [0079]). 



(see continuation of citations and explanations in second supplemental box) 
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In case the space in any of the preceding boies is not sufficient. 

Continuation of: 

citations and explanations from first supplemental box 

Claims 9-11. 26-28. 45. 46. and 49 lack an inventive step under PCT Article 33(3) as being obvious over Itokawa in view of US 7.146.026 
B2 to Russon et al. (hereinafter 'Russon'). 

As per claims 9 and 26, Itokawa does not disclose the method of claim 8 and image capture device of claim 25, wherein the modifying 
comprises correcting a red-eye defect within the face region of the main image based on the one or more reference images. However, 
Russon discloses correction of an eye defect within the face region of the main image based on the one or more reference images (see 
Abstract). It would have been obvious to one of ordinary skill in the art to combine the system of Itokawa with the eye correction of Russon 
to provide correction of a common source of picture ruination. Itokawa and Russon do not specifically disclose red-eye. However. Russon 
discloses correction of an eye defect within the face region of the main image based on the one or more reference images (see Abstract). 
Therefore, it would have been obvious to one of ordinary skiil in the art to correct red-eye because as a common eye defect in images. 

As per claims 10 and 27, Russon discloses the method of claim 8 and image capture device of claim 25, further comprising correcting a 
blink within the face region of the main image (see Abstract). 

As per claims 1 1 and 28, Russon discloses the method of claim 8 and image capture device of claim 25, further comprising changing a 
facial expression within the face region of the main Image (see Abstract, facial expression - eyes). 

As per claim 45, Itokawa does not disclose Ihe device of claim 44, wherein said eye region in Ihe main image that is replaced is 
determined to be closed or semi-closed. However, Russon discloses said eye region in the main image that is replaced is determined to 
be closed or semi-closed (see Abstract). It would have been obvious lo one of ordinary skill in the art to combine the system of Itokawa 
with the eye correction of Itokawa because this corrects the most common source of picture ruination. 

As per claims 46 and 49, Itokawa discloses the device of claim 45 and claim 48 wherein said reference that comprises said eye region is 
captured a fraction of a second before or after a blinking action (see para |0079|; [0010]). 



Claims 1-52 have industrial applicability as defined by PCT Article 33(4) because the subject matter can be made or used in industry. 
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